Self‐supervised non‐rigid structure from motion with improved training of Wasserstein GANs
نویسندگان
چکیده
This study proposes a self-supervised method to reconstruct 3D limbic structures from 2D landmarks extracted single view. The loss of self-consistency can be reduced by performing random orthogonal projection the reconstructed structure. Thus, training process using geometric in reconstruction–projection–reconstruction process. network mainly consists graph convolution and Transformer encoders. is called SS-Graphformer. By adding discriminator, SS-Graphformer used as generator form Wasserstein Generative Adversarial Network architecture with Gradient Penalty improve accuracy reconstruction. It experimentally demonstrated that addition structure discriminator significantly
منابع مشابه
Improved Training of Wasserstein GANs
Generative Adversarial Networks (GANs) are powerful generative models, but suffer from training instability. The recently proposed Wasserstein GAN (WGAN) makes progress toward stable training of GANs, but sometimes can still generate only poor samples or fail to converge. We find that these problems are often due to the use of weight clipping in WGAN to enforce a Lipschitz constraint on the cri...
متن کاملImproved Techniques for Training GANs
We present a variety of new architectural features and training procedures that we apply to the generative adversarial networks (GANs) framework. Using our new techniques, we achieve state-of-the-art results in semi-supervised classification on MNIST, CIFAR-10 and SVHN. The generated images are of high quality as confirmed by a visual Turing test: Our model generates MNIST samples that humans c...
متن کاملImproving the Improved Training of Wasserstein GANs: A Consistency Term and Its Dual Effect
Despite being impactful on a variety of problems and applications, the generative adversarial nets (GANs) are remarkably difficult to train. This issue is formally analyzed by Arjovsky & Bottou (2017), who also propose an alternative direction to avoid the caveats in the minmax two-player training of GANs. The corresponding algorithm, called Wasserstein GAN (WGAN), hinges on the 1-Lipschitz con...
متن کاملNonrigid Structure from Motion in Trajectory Space
Existing approaches to nonrigid structure from motion assume that the instantaneous 3D shape of a deforming object is a linear combination of basis shapes, which have to be estimated anew for each video sequence. In contrast, we propose that the evolving 3D structure be described by a linear combination of basis trajectories. The principal advantage of this approach is that we do not need to es...
متن کاملRelaxed Wasserstein with Applications to GANs
We propose a novel class of statistical divergences called Relaxed Wasserstein (RW) divergence. RW divergence generalizes Wasserstein distance and is parametrized by strictly convex, differentiable functions. We establish for RW several key probabilistic properties, which are critical for the success of Wasserstein distances. In particular, we show that RW is dominated by Total Variation (TV) a...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Iet Computer Vision
سال: 2023
ISSN: ['1751-9632', '1751-9640']
DOI: https://doi.org/10.1049/cvi2.12175